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AdvBrtiaettBnt Mmitoting Aad Feedback Syatm 

BMkfCOB&d of tlitt iBvwition 

5 Cable television sexvioe pxovidere have typically provided 

one-way broadoast aexvices but now of fee high-speed data 
services and can ooiidt>lne traditional analog Itroadcast? with 
digital broadcaatd and aocesa to Internet mb sites. Telephone 
companies can offer digital data and video programming on a 

10 twitched basis over digital subsoriber line technology. 

Although the aubsoriber my only be presented with one channel 
at a titne^ channel change requeate era instantaneously 
transmitted to centralized switching equipment and the 
aubacriber can access the programralng In a broadcast-like 

15 manner. Internet Service Providers (ISPs) offer Internet 
access and can offer access to text, audio^ and video 
programming which can also be delivered in a broadcast- like 
manner in which the subscriber selects ''chamiels'^ containing 
programming o£ interest- Such channels jnay be offered as part 

20 of a video programming service or within a data service and can 
be presented within an Internet browser. 

Advertisements are a part of daily life and certainly an 
in^ortant part of entertainment programming^ where the payioents 
for advertisements cover the cost of network television. A 

25 mebhodi which provides a flexible billing plan to cable network 
users based on the amount of advertisements viewed is described 
in U.S. Patent No. 5,532^735/ which discloses a method of 
advertisement selection for interactive services. A user 
asaociated with an interactive TV is presented with a program 

30 and a set of advertisements. The user can indicate the amount 
of advertisements in the set of advertisements he wants to 
view. 

While advertisraients are sometimes beneficial to 
subscribers and deliver desired information regarding specific 

1 
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products or servlce&r consumers generally vlev advertising as a * 
^necessary evil'' for broadcast'-kypd entertainment. For 
exempler a method for obtaining Informtion on advertised 
services or produc±a is described in U.S. Patent No. 5,708^478/ 
5 which discloses a oon^uter system for enabling radio listeners 
and television watchers to obtain advertising information* the 
system determines whether an incoming video or audio signal 
includes advertisement specific ^ta for an advertiser arid 
captured and stores the advertiser specific data. 
10 Hanufaotuxers pay an extremely high price to present ^ in 

30 eeoonds or less i an advertisement for their product, which 
they hope a consumer will watch. Unfortunately for the 
manufacturerr the consumer frequently uses that interval of 
time to check the programming being presented on other 
15 channels^ and may not watch any of the advertisement. 

Alternately/ the consumer may mute the channel and ignore what 
the manufacturer has presented. In any case the probability 
that the consumer has watched <tbe advertisement is quite lov« 
It is not until raillloVs of dollars have been spent on an 
20 advertising cacqpaign that a manufacturer can determine that the 
ads have been effective* This is presently accomplished by 
monitoring sales of the product or IV programs or channels 
viewed by usets as disclosed in various public documents. As 
an example, U.S. Patent No. 4r 546^382 discloses a television 
25 and market research data collection system and method. A data 
collection unit containing a meiaory stores data as to which of 
the plurality of TV modes are in use, which TV channel is being 
viewed as well as Input from a suitable optioal scanning device 
for collecting information about the user's product purchases. 
30. Another system described in U.S. Patent No. 4,258/386 discloses 
a television audience measuring system* The syst^ monitors 
and stores information representative of channel 
identificationr the time at which the channel is aelected and 
the time at which the selection of a channel is terminated. 

2 
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O.S. Patent Ko. 5,608,445 dlecLoses a method and d^lce £o£ 

» . ■ * 

data capture In television, viewer research. Oevioee axe 
attached to a video Inetallation in order to determine to which 
channel a set la tuned. 

5 With the advent of the Internet^ nanufaoturers and service 

providers have found waya to selectively insert their 
advertisements based on a SMbscrihers requests for information. 
h9 an example, an individual who searches for ^oars" on the 
Internet may sea an advertisement for a particular type of par. 

10 Various lntemet«-ba6ed advertisers use this method* The 
product literature from IMGtS Inc.,^ Ad Force/' printed from 
the World P?lde Web site 

http; //www. starpt.oom/oore/ad^Target. html on June 30, 1998 
discloses an ad targeting system. The Byst«n delivers ads to 

X5 wsb site visitors based on the content of the web page, time of 
dayr day of the week, keyword, by the number of timea a visitor 
sees an advertifiement and by the order in which a series of 
advdrtiswents are shown to a visitor. IQeverthelesSf unless 
the subscriber actually goes to the advertised web site, there 

20 i9 no way to determine If the advertisement has been watched. 
Ab the content on the Internet migrates bo multimedia 
programming including audio and video, the costs for the 
advertising will increase/ but unless the advertiser can be 
sure that a significant percentage of the message was watched 

25 or observed, the advertising is- ineffective « Prior art 

products for generating reports of ad canpaigns are generally 
PC-centric as described in various product literature which 
include the product literature £tm Doubleclick Inc., 
"Doubleclick: Repotting,'' printed from the World Wde Web [Wm) 

30 site http; //www. doublecUck.net/dart/howl_repo. htm on June 19r 
1998r which discloses the reporting capabilities of 
Doubleclick's Dynamic Advertising Reporting fi Targeting (DllRT) 
product. The information in tb? reports includes daily 
impressions by advertisement type, average impreasion per day 

3 
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of week and by hour ox day. The avexage sesponse sate p«£ user 
is also included in the reports. The product literatuw from 
Netgravity Inc. "AdServer 3," printed from the World Wide Neb 
site httpj/Zww. netgravity. oom/producta/ on July 9, 1998 
5 disoloses Netgravity' a Adservez 3 product for online 

adveztiBoaent. The product generates reports including the 
profiles ot visitors who viewed an ad and site traffic 
throughout the day, weeki aonth and year. 

The prodttot literature from Media Metrix ^Frequently Asked 
10 Questions", priated from the World Hide Neb site 

http;//»ww.reedlametrix.eQm/loteract_mfaq.htm on June 30^ 1998 
disoloses Media Hetrix^s software, ""PC Meter", that runs in the 
background of a PC and monitors everything being done on that 
nadhlne. It detenaiaes who is using the PC by age, income, 
15 gender and geographic region and tracks usage of software 

application, conmezcial online services and detailed page level 
viewing of the World Wide Heb. The marketing literature from 
Katchlogic Inc., ^Centralized Ad Management," printed from the 
World Wide Web site 
20 http://www.matohlogic.com/docB/BervicBs2, htm on July 1, 199B 
discloses Matchlogic services for ad management. The services 
include delivering advertisements based on pre-defined 
targeting criteria, generating reports on how many unique 
viewers saw which banner and how many times it was viewed. The 
25 product literature from ftccipiter Inc.," Accipiter Adbtenager 
2.0," printed from the World Wide Web site 
https //www. accipiter.com/products/ADMaaager/fab. html on July 9f 
1996 discloses Accipiter' s ad management system. After 
delivering an advertisement based on pre-defined criteria, the 
30 syetem can generate reports on an ad campaign. The reports 
include visitors' demographic data, number of ia^jressions and 
clicks generated from the entire site and by each ad and 
advertiser. 

4 
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In order to deliver more targeted programming and 
advertleing to subscribers, it is necesaary to understand tbelr 
Ilkea and dialikea to a greater extent then is presently done 
today. Syatems which identify subscriber preferences baaed on 

5 their pvucch&ses and responses to queationnaires allow for the 
targeted marketing of lltexatuxe in the mail^ but do not In any 
98X190 allow for the rapid and predae delivery of progranimlng 
and advextising which ia known to have a high proba)?ility of 
acceptance to the subscriber. Other ayatema give uaera the 

10 poaslbility to chooae their programming as deacribad in O.s. 
Patent No. 3r223r924 which dlacloaes a syatam and method for 
automatically correlating uaer preferencea with a IV program 
information database. The syatein inoludea a proceasor that 
performs ^free texf^ aaarch teohnlquea to correlate the 
* 15 downloaded TV program information with the viewer^ a 

preferencea. Thla ayatem requirea an interaction between the 
users and the prcgramming. The white paper from Net 
Percoptiona corporation entitled ^Adding Value in the Digital 
Age" and printed from tbe World P7ide Web site 

20 http: //www. netperceptiona f com/product a/white-papers .html on 

June 30/ 1998 disoloaea hew the GroupI>ena Recommendation Engine 
gives online bu^ineaaes the ability to target and personalize 
servicea^ content, products and advertising, A learning 
process learns perscaal information about an individual using 

25 explicit and implicit ratings i .a prediction pirocess predicts 
user preference using collaborative filtering and the 
recommendation process recommenda products or services to users 
based on predictions* 

The product literature from Aptex Software Inc., 

30 ^^SeleotCast for Commerce Servers, " printed from the World Hide 
Web site http: //wwwe aptex . oom/products-aelectcast-commerce . htm 
on JMne 30| 1998 describee the product '^SelectCasf for 
Commerce Servers. It personalizes online shopping baaed on 
observed user behavior. Oaer intereata are learned based on 
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the content they btowBe, the prwaotlons they dick and thb 
products they purchase. 

In order to detezmine which progreming or advertising La 
appropriate for the eubaoriber, knowledge of that sutoscriber 
5 and the subscriber product and programing preferences ia 
required. Different methods are being used to gain knowledge 
of user's preferences and to profile the users. Generally, 
these methoda use oontfent or data mining techuologiea to 
profile users or predict their preferences. Another technique 
10 for predicting user's preferences is based on the use of 
collaborative filtering ae described in U.S. f stent No. 
5,704,017 which diaclosea a oollaboeative filtering system 
utilizing a belief network. The system learns a belief network 
using prior knowledge obtained from an expert in a given field 
15 of decision making, and a database containing empirical data 
such as users' attributes as well as their preferences in that 
decision making field. The belief network can determine the 
probability of the unknown preferences of the user given the 
known attributes and thus predicts the preference most likely 
20 to be desired by the user. 

The produot litftrature from Aptex software Inc. , 
^SelectCast fox Ad Servers," printed from the World wide Meb 
site httpi//w«w.aptex.oom/produc!t8-8el6etoast-ads.htin on June 
30, laSS discloses an ad targeting system from Aptex Software 
25 Inc. The system employs neural "networks and a context vector 
data model to optimize relationshlpe between users and content. 
It provides user profiling by mining the context and content of 
all actions including clicks, q.ueriee^ page views and ad 
iRipreseions. ;^tex'e technology usee a context vector data 
30 modeling technique described in U.S. Patent Ho. 5,619,709 which 
discloses a system and method of context vector generation and 
retrieval. Context vectors represent conceptual relationships 
among Information items by quantitative means. A neural 
network operates on a training corpus of records to develop 
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relationahip-based context yeotora based on word proximity and 
co-import anoe. Geomdtrio relatioi^shlps among context vectors 
axis representative of conceptual relationehips among tbelr 
asaociated Items* 
5 The product data sbeet from Open Sesamoi ^^Learn Seaame,'' 

printed fxocn the World Hide Web eite 
https//www.opense6dm8.Gsom/prod^04ihtinl on CToly 09/ i99B 
disclosea Open Sesame' s personalisation product for Web 
enterprlaesa It learns about wars automatically from their 

ID brovaing behavior. 

The product literature from Bagage Technologies/ 
""Engage. Discover/'^ printed from the World Wide Web site 
>ittp;//mirv.engagetecb«oom on July 09 r 1998 discloses Engage 
^Technologiea' product for user profiling. User^-disclosed 

15 information such as interest; demographics and opinldns are 
coiobined with anonymous clickstream data that describes where 
users come from before visiting the site/ how long they atay^ 
and what pages or types of pages they visit moat frequently to 
build the visitor profile. 

20 The marketing literature from BroadVisioO/ ^^rhe Power of 

Personalization^'/ printed from the World Wide Web aite 
http: //www* broadvi sion.cam/coDtent /corporate /brochuxe/Broob4.ht 
jii on August 21/ 1998 discloses the BrcadViaion Q/^e- to-One • - 
application profiling ayatem, The system learns about users 

25 through a variety of techniquea- including registration, 

questionnaires/ observation and integration of hietorical and 
externally generated data. 

The marketing literature from the ElreCly Corporation/ 
^Firefly Passport Office/ printed from the World Wide Web site 

30 http: //www. ficefly,nBt/ccnv>any/PassportOf fioa.html on June 20, 
1998 discloses Firefly's Relationaliip Management software. The 
software enables online businesaea to create/ extend and manage 
personal profiled for every user. 

• 7 
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Specific information reyardiog a subscriber' e viewii^ 
habits or the Internet web sites tliey have accessed can be 
stored for aoalysis, fattt such records are considered private 
and subsoribers are not generally willing to have such 

5 information leave their control. Although there are regulatory 
models, wbtoh permit the collection of such data on a "notice 
and oonseat* basis, there is a general tendency towards legal 
rules, which prohibit such raw data from being collected. 
With the ndgration of services from a broadcast based 

10 model to a client-server based model in which subscribers make 
individualij&ed requests for pxogcairaning to an Internet aooese 
provider or content provider, there is opportunity to monitor 
the subscriber viewing characteristics' to better provide them 
with progrsjnming and advertising which will be of interest to 

15 them. A server may act as a proxy for the subscriber reqiieata 
and thus be able to monitor what a subscriber has requested and 

I 

is viewing. Since subscribers nay not want this raw data to be 
utilized, there is a need for a system which can process this 
information and generate statistically relevant subscriber 

20 profiles. These profiles should be aocesaible to others on the 
network who may wish to determine if their programming or 
advertisements are suitable for the subscriber. In a 
broadcast-based model, the Infonnation to be processed can be 
enibedded within the TV program or broadcast separately and can 

25 be in the form of an electronic "program guide (BPQ) or text 

information related to the program. As en exair^le, U.S. Patent 
No. 5,579,055 discloses an electronic program guide (BPG) and a 
text channel data controller. The text and BPG data are 
embedded in the vertical blanking Interval of the video signal 

30 and extracted, at reception, by the data controller. The EPG 
contains information fields such as program category, program 
subcategory and program content description. 0,3. Patent No. 
5,596f373 discloses also a method and apparatus for providing 
program oriented information in a multiple station broadcasting 

8 
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systeni. The EPG data includes guide data^ channel data and 
program data. The program data inoludaa among other 
informatloHf the program title, the program category/ the 
program aob-oategoxy and a detailed deacriptioi) of the program. 
5 Some efforts have been made to transmit targeted 

advertisements and thereupon oollect feedback on the 
transmitted advertisements. For example, U.S. Patent 
t)o.5/948|061 provides methods and apparatuses for targeting the 
delivery of advertisements over a network suoh as the Internet. 

10 Statlatica are conplled on individual users and networXa and 
the use of the advertisements is tracked to permit targeting of 
the advertis^ents to individual users. In response to 
requests from affiliated sitesi an advertising server transmits 
to people aooessing the page of a site an appropriate one of 

15 the advertisements based upon profiling of uaers and networks. 

Furthermore, U.S. Patent No. 6,005,597 provides a method 
and apparatus for television program selection that monitors 
the viewing preferences of a viet^er to create a dynamic viewer 
profile that is used to rate available programs. Baaed on the 

20 viewer profile, available programs are sorted and presented to 
the viewer in descending order of predicted interests The 
invention allowa a viewer to quickly find the program of 
greatest interest to the viewer without having to tediously 
search through large numbers of available programs* The 

25 invention may also be used for.eelecting from among a plurality 
of programs other than television programs, such as, for 
example, radio programs or audio or video programs stored on 
digital storage media such as CD's and DVD's. 

U.S. Patent Ho. 5,446/919 provides a communication system 

30 capable of targeting a demographlcally or psychographioally 
defined audience. A master database is maintained, containing 
demographic and psychographic information about eadi audience 
member. This infozmtlon is transmitted and stored in a 
channel selection/decoder unit associated with each audience 
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member's tficeiver. Multiple media neaaages axe transmlttad to 
eaoh audlenoe member. Aooon^anying the transadssioQ Is a 
seleotloa pcoflle conimandr which details the 
deraogxaphic/peyehographio profile of audience members that are 
5 to receive each media message. The channel selector/decoder 
unit associated with each member's receiver con^iares the 
selection profile with the demographio/peyohographic 
information about the audie&ce meslber and selects the 
appropriate media message fox that audience member. 
10 U.S.' tabefnt Nos. 5,J&1,73S and 5/848,396 disclose a 

coiq;mter netWork method aAd apparatos which providee targeting 
of an appropriate audienoe based on peycdiographic or behavioral 
profiles of end users. The psyehographio "profile is formed by 
recording computer aotivity and viewing habits of the end user. 
15 Content of categories of interest and display format in each 
category are revealed by the psychogxaphic profile, based on 
user viewing of agate information. Using the profile (with or 
without additional user demographics) r advertisements are 
displayed to appropriately selected users. Baaed on regression 
20 analysis of recorded respanses of a first set of users viewing 
the advertisements/ the target user profile is refined. 
Viewing by and regression analysis of recorded responsss of 
subsequent sets of users continually auto-targets and 
customizes ads for the optimal end user audience. 
25 U.S. Pat«it No, 5,155,591 p'rovides e functionality where 

different commeroial messages are broadcast to different 
demograpblcally targeted audiences in a cable television system, 
or the nice. A first television channel contains television 
programs and periodic commercial messages. A second television 
30 channel contains alternate oommaroial messages. Demographic 
characteristics of a viewej; are identifiedr and commercial 
jnessages are selectively provided from the first or second 
channel, depending upon the viewer's demographic 
'characteristics. Demographic data can be input by a viewer via 

10 
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a remote control, dovnloaded to a 9ubBcxiber*8 converter from a 
remote head-end, or programmed Into tlie converter at 
iDBtaLlatlon. Prioritization of the demographic 
characteridtlc3 of a plurality of television viewers watching a 

5 prdgfam together enables conmeraials to be targeted to the 
viewer having blghoet priority. Statlatioal data can be 
maintained concerning the number and identity of subacrlbera 
viewing specific commerolale. 

U.S. Patent No, 5,774/170 enhances television (and radio) 
^ ID advertising by targetlngr delivering and displaying electronic 
advertlaing messages (opmmerQials) within specified programming 
in one or more pre-determined households (or on specific 
display devices) while simultaneously preventing a commercial 
from being displayed in other households or on other displays 

15 for which it is not intended. Cofmnercials can be delivered to 
specified homes or displays via either over-the-air ox wired 
delivery systems. 

O.Sr Patent No. 5,446,919 provides a communication system 
capable of targeting a deraographically or psyohographioally 

20 defined audience. A master databaae is maintained, containing 
demographic and psychographlc information about each audience 
mernber. This information is transmitted and stored in a 
channel selection/decoder unit associated with each audience 
member's receiver. Multiple media messages are transmitted to 

25 each audience mamber. Accompanying the transmission is a 
selection profile command, which details the 
denK>graphlc/pBycbographic profile of audience members that are 
to receive each media message. The channel selector/decoder 
unit associated with each member's receiver compares the 

30 selection profile with the demographic/psychogxaphic 
information about the audience member and selects the 
appropriate media message for that audience member • 

ZEES Publication: rramawork for targeting Banner 
Advertising on the Internet" by Gallagher and J. Parsons, 

U 
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(ran. 1997, presents a model for effectively and efficiently 
targefciifig hypermedia-based banner advertieementB in an online 
information aervice. The model takes advantage of information 
tactoology to tticro-target banner advertisements based on 
individual cltaracteristice of users. 

0*S. Patent Ho. 5,636^346 provides a method and system fox 
selectively targeting advertisements and prograirtming to 
different demographically and specially targeted television 
audieoceb by relating carrier subscriber data to other 
proprietary marketing databases by creating^ compiling and 
updating a National Directory of cable and other carrier system 
aubsoriber names and address information derived from actual 
cable system and telephone company billing records* 

The above*-mentioned systems and methods provide many 
different ways to select and deliver targeted advertisement e. 
However/ these systems lack the means for monitoring displayed 
advertisements and collecting feedback. Such monitoring and 
feedback systems are typically not available in television 
environments . 

For the foregoing reasons/ there is a need for an 
advertisement monitoring and feedback system that may monitor 
advertisements that have been viewed by a subscriber and 
provide feedback to a subscriber characterization system which 
may generate one or more subscriber profiles that incorporate 
advertising related information. Such subacriber profiles may 
assist advertisers in determining the 9uccess rates of the - 
advertisements being broadcast and accordingly advettisera may 
allocate financial aources on the advertisements that are 
likely to succeed in getting the attention o£ the subscribers. 

Summary of tba Invention 

The present invention encompaasea an advertisement 
monitoring system that determines to what extent an 
advertisement has been viewed by a subscriber or a household, 

12 
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and generates one or moid records of the subscriber advertising 
delecbion data. Ii^ a preferred embodiment, the eubecriber 
advertising selection data inoludee the channel selected and 
the time at which the channel waa select ed» Advertisement 

5 related informatio?) including the type of produot, brand name/ 
and other descriptive Information that categorizes the 
advertisement la also extracted and added to the advertising 
selection data. The advertisement related information might 
also be extracted from the closed-^aapbioning text. Based on 

10 this advertisement selection data, a record is created 

documenting what percentage, if any^ of the advertisement wan 
watched. This record is- then fed back to the subscriber 
characterization systemi wherein the subscriber 
characterization system my comprise one or more filters. 

IS The subscriber characterization system also monitors the 

svbscxiber viewing habits associated with program viewing and 
generates one or more records of program selection choices* 
The program selection choices include the viewing time 
duration, number of channel changes, volume at which the 

20 programming is listened, program selection, and text 

information about the programming. The records are used to 
determine what type of programming the subscriber is most 
interested in. The subscriber characterization system 
characterises stubscribers based on feedback information from an 

25 advertisement monitoring system and monitors their detailed 
program viewing selections. 

Furthermore, the subscriber characterization system is 
equipped with one or more filters that BBslst in determining 
and eliminating from consideration/ selection data associated 

30 with irrelevant activities by the subscribert Examples of 
irrelevant activities include selection data associated with 
channel surfing and/or channel jumping (up and down) 
activities t 

The channel surfing activity refers to one or more rapid 

13 

5/4/05, EAST version: 2.0.1.4 



wo 01^747 PCMl8Dl/0Ma9 

cbamiel changes initiated l>y the subacribdr for the purpo&e of 
selecting k ch^ndl /program for actual viewing. Generally, the 
sub9oriber aelectfi a channel/ and viewB the contents of the 
program at the selected oKannel. for a fev seconds (about 3-4 
5 seconds) r and then changes the channel to view the contents of 
the next channel. Such rapid changes generally occur a few. 
timed in a row before the subscriber selects a 
channel /programming for actual viewing » The filters of ths 
present invention are configured to detect channel surfing 
10 aotivitiea by the aubscriber by monitoring and evaluating 
associated viewing times/ The channel surfing activities ace 
filtered out and thus not considered in. the determination of 
actual viewing selections. 

The channel junking refers to an activity wherein the 
15 subscriber changes channels very rapidly in order to move from 
an existing channel to a desired channel » Therein^ the 
subscriber is not channel surfing, instead the subscriber 
already knows th« intended channel/program for actual viewing 
and is jumping channels to reach the desired channels. For 
20 example, if the subscriber is at channel number 6, and wants to 
go to channel nuzober 12, the subscriber may jmp the channel by 
changing the channel six times. Generallyr in channel jumping, 
the channel changes occur very rapidly and the viewing time at 
the each channel is very brief , e.g./ less than one second. 
25 The filters of the present invention are configured to detect 
and filter out channel jumping. Thus, the channel jumping 
activities are not considered in the deterttdnation of actual 
viewing selections. 

The filters of the present invention are also capable of 
30 monitoring extended spans of inactivltyi e.g., a lack of any 
channel changes, volume changes, or any other selection changes 
activity for more than 3 hours . Such spans of inactivity are 
considered ''dead periods'' implying that the subscriber la not 
actively watching the video and/or other multimedia 

14 
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prograTRndng, The reaaoas for suoh dead periods may ba caused 
by the fact that tho subscriber has le£t the rocna^ or the 
subsoxiber is Dot aotiye (e«g«f bhe oubacriber baa gone to 
sleep or haa doxed off), or the fact that the subscriber is 
5 actively engaging lo another activity within the room and la 
not attending to the programming « 

The subscriber characterization system of the present 
invention analyzes the actual viewing seleotiona made by the 
subscriber or the aubsorlber household r end generates a 

Ifi deroogtaphlc description of the subscriber or household. This 
demographic description describes the probable age, incomei 
gender and other demographics. The resulting characterisation 
includes probabilistic determinations of what other pzogxaiarDing 
or products in which the subscriber/household will be 

15 interested. 

In a preferred embodiment, the text information related to 
the advertisement la processed using context mining techniques 
which allow for classification of the advertisement and 
extraction of key data including product type and brand. 

20 Context mining techniques allow for determination of a product 
type, product brand name and in the case of a product which is 
not sold with a particular brand name^ a generic name for the 
product I 

The present Invention can also be realized in a olient- * 
25 server mode in which case the advertising related information 
is collected at the client side of the network and la then 
transmitted to the server aide via a secure coniiectlon. The 
server side then Incorporates this information with other 
subscriber information to create subsoriber profiles, 
30 These and other festures and objects of the invention will 

be more fully understood from the following detailed 
description of the preferred embodiments which should be read 
in light of the accompanying drawings. 

IS 
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Brief Dft9ori]^tlo& of thm Oc&wixigs 

The aocM^znpanyiag drawlngd, which «re incorporated in and 
form a part of the apaclficationi illustrate the einbodlnenta of 
the present invention and, together with the description serve 
5 to explain the principles of the* invention. 
In the drawings! 

riG. lA illustrated a context diagram for an advertising 
monitoring and feedbaclc eystem (AHFS), is accordance with one 
eiDbodiment o£ the present invention; 
10 IB illustrates a context diagram iEor an advertising 

mbnitoring system (AMS), in aooorda^iice with one embodiment of 
the preeent invention; 

FIG. IC illustrates a context diagrain for a subscriber 
characterisation system with filters (SCSP) / in accordance with 
IS one embodiment of the present invention; 

FIG. ID illustrates a functional diagram o£ the procesalng 
utilised by the filters; 

FIG. 2 illustrates a block diagram for a realisation of a 
subscriber monitoring system for receiving video signals; 
20 FIG. 3 illustrated a block diagram of a channel processor; 

FIG* 4 illustrates a block diagram of a computer for a 
realization of the advertisement monitoring system; 

FIG. 5 illustrated a channel aequence and volume over a 
twenty-four (2<) hour period; 
25 PIG. 6A illustrates a time of day detailed record; 

FIG. 6B illustrates the processing utilized to determine 
channel surfing activities; 

PIG. 60 illuatrates the processing utilized by filters to 
determine channel- jumping activities; 
30 FIG. 7 Illustrates a household viewing habits statistical 

table; 

FIG. 8A illustrates an entity-relationship diagram for the 
generation of program characteristics vectors; 
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FIG. BB Illustrates a flowchart for program 

characterization; 

FIGS* 9A illuat rates a determlolstio program category 

vector; 

5 FIG. 9B illuatrates a detertninlstlc program sub^category 

vector; 

FIG* 90 llluatratos a determlslatlc program rating vector; 
FIG. 9D lIluatrateB a probabillstio program category 
vector; 

10 FIG* 9E illuatrates a probab'lliatlc program aub-category 

vector; 

FIQ» 9F illustrates a probabillstio program content 
vector; 

FIG. lOA illustrates a set of logical heuristic rules; 
15 FIG. lOB illuetrates a set of heuristic rules expressed In 

terms of conditional probabilities/ 

FIG* 11 illuetrates an entity-relationehip diagram for the 
generation of » program <iemographlo vectors; 

FIG* 12 illuetrates a program demographic vector; 
20 FIG. 13 Illustrates an entity-relationship diagram for the 

generation of household seasion demographic data and household 
session interest profiles; 

FIG. 14 illustrates an entity-relationship diagram for the 
generation of average and session household demographic 
25 characteristics; 

FIG. 15 illustrates average and eession household 
demographic data; 

FIG. 16 illustrates an eTitity^relationship diagram for 
generation of a household interest profile; 
3D FIG. 17 illufitrates a household interest profile including 

programming and product profiles; 

FIG, 18 illustrates a olient-server architecture lor 
realizing the present iovention; and 

FIG* 19 illustrates an advertisement monitoring table* 

17 
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Of Sb« Praf orcod SnbodlMat 

In desoribing a prefetxed embodiment of the Invent Iod 

5 illustrated in the drawings/ speoific terminology will be used 
for the sake of clarity. However, the invention ie not 
intended to be limited to the dpeclflc termd so aeleoted^ and 
it is to be understood that eaoh epeoific term include? all 
technical equivalents which operate in a aimilar manner to 

10 aocomplifih a similar purpose* 

With reference to the drawiogs/ in general/ and HGS. 1 
through Id in particular, the apparatus of the present 
invention is dieolosed, 

F16. lA illustratea a context diagram of a preferred 

15 embodiment of an Advertising Monitoring and Feedback System 
(AMF8) 100 t The AMFS 100 compriees an advertising monitoring 
system (AHS) 102 and a subscriber- characterization system with 
filters (SCSP) 104, k context diagram^ in oonibinetioa with 
entlty-relatioDsbip diagramsr provide a basis from which, one 

20 skilled in the art can realise the present invention. The 
present invention can be realized in a number of programnvlng 
languagee including Cr C-l-f, Perl, and Java/ although the scope 
of the invention is not limited by the choice of a particular 
programming language .or tool. Object oriented languages have 

25 eeveral advantages in terms of construction of the aoftware 
used to realize the present invention, although tbe present 
invention can be realized ib procedural or other types of 
progranoning languages knowa to those skilled in tbe art. . 
Nithin the AMFS 100/ the MS 102 monitors subscriber 

30 advertising viewing activities, processes them, and generates 
advertising selection data. The AMS 102 then forwards the 
advertising selection data to the SCSP 104 which further 
processea the advertising related information received from the 
AH8 102 « The SCSF 104 also monitors subscriber viewing habits 

18 
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as they relate to actual programming iivfocin^tion« SCSF 1D4, 
based on advertidi^g related Information and the actual, 
progransnlng Information^ generates one or more subscriber 
profiles 106 r therein eaoh sub8ori]>ex profile indicates a 
5 probabilistic measure of subeorlber demographias atid/or 
preferences. 

As illustrated In Fli?. IBp in generating one or m>re 
xeoords of advertisement eelectionsr the AMS 1D2 receives from 
a eubaoriber 120A oonniands in the form of a volume control 

10 signal 124A or advextialng selection data 122A \ihich can be in 
the form of a cbannel change » The advertising material being 
viewed by the subscriber 120A is referred to as source material 
130A. The source material 130A^ aa defined hereinr is the 
content tbat a subscriber selects and may consiat of analog . 

15 video, Motion Picture Expert Groi^ (MPEG) digital video source 
materlalf other digital or analog material, Hypertext Markup 
Language (HTML) or other type of multimedia source material. 
The AM3 102 can access the source material 130A received by the 
aubscriber 120A using a start signal 132A and a stop signal 

20 134A, which control the transfer of source related text 13€A 
vhich can be analy3ed as des-oribed herein. 

In a preferred embodimentr the source related text 135A 
can be extracted from the source material 130A and stored in 
memory. The source -related text 136A^ ae defined herein, 

25 includes source relat^^d textual information including 

descriptive fields which are related to the source matejcial 
• 130A, or text which ie part of the source material 130A itself. 
The source related text 13?A can be derived frost a nuniber of 
sources including but not limited to closed-captioning 

30 information, Electronic Program Guide {BPQ) material , and text 
information in the source itself (e.g. text in HTML files). 

An Electronic Program Guide (BP6) 14Qa contains 
information related to the source material 130A which is useful 
to the subscriber 120A. Hh^ BP6 140A is typically a 

19 
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navigational tool whioh contains source related infonciationf 
incltiding bat not limited to, the programming oategoryr program 
description^ rating, actors, and (Juration, The structure and 
contont of SPG data ia described in detail in US Patent 

5 5^596/373 assigned to Sony Corporation and Sony Electronics^ 
irhe 140A can be accessed by the AHS 102 by a request EP6 
data signal 142A which results In the return of a category 
144A^ a sub-category liSk, and a general advertisement (ad) 
description 148Ai The BP6 140A can potentially include fields 

10 related to advertifilng* In one eobodinent of the present 
invention, the EPG information such as the category 144A| the 
sub-category 14€Ar and the general Bdvertiseonnent description 
14 6A are stored in a memory. 

In another embodiment oi the f^reaent invention, the source 

15 related text 135a is the closed-captioning text embedded in the 
analog ^or digital video signal. Such clcsed-captioning text 
can be stored in a memory far processing to extract the 
advertising characteristics related information » 

One of the functions of the MIS 102 is to generate one or 

20 more records of advertisement selections llOA which are 
comprised of advertising characteristics. The advertising 
selsction record llOA may be obtained from the laonitored 
activities of the subscriber 120A and in a preferred embodiment 
can be stored in a dedicated memory. In an alternate 

25 embodiment, the advertising selection record llOA may be stored 
in a storage disk. In an exKnplary case, the information which 
is utilized to form the advertisemeibt selection data llOA 
includes time 112A, uhioh oo7r«Bpond5 to the time of an events 
diannel ID program ID 116A, volume level 118A, channel 

30 change record USA, end advertising title 117A. The AMS 102 
foxwarde the adverttslng- selection keoords llOA to the SC8F 1D4 
for further pro6e»8ing and fox generating subscriber profiles. 

716. IC depicts the context diagram of a preferred 
eipbodlment of the 104. 

20 
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In the prDceee of oollecting raw subscriber Qelectlon 
data, the SCSF 104 received from a subecribor 120B coiamande In 
the form of a volume oontrol signal 124B or program aelection 
data 122B which can be in the form of a channel change but may 
5 also be an addrees request which requests the delivery of 
programming from a network address. A record signal 12 6B 
indicates that the prograioming or the address of the 
programming Is being recorded by the aubscriber 120B« She 
record signal 126B can also be a printing command, a tape 

10 recording coinmandf a boolonarlc cq^nd or any other command 

intended to store the program being viewed, or program address r 
for later use. 

The material being viewed by the subscriber 120G is 
referred to as source material I30B. The source material 1306, 

15 as defined herein, is the content that a subscriber selects and 
may consist of analog video, digital video such as MPEG digital 
video. Hypertext Markup Language (HTML)f or other types of 
multimedia source material. The SCSP 104 can access the source 
material I30& received by the subscriber 120B using a start 

20 signal 132B and a stop signal 134B| which control the transfer 
of source related text 136B which can be analyzed as described 
herein* 

In a preferred embodimenti the source related text 136B 
can be extracted frcon the source material 13DB and stored In 

25 memory. The source related testt 136B, as defined herein. 
Includes source related textual informtion including 
descriptive fields which are related to the source material 
130B, or text which is part of the eource material 130B itself. 
The source related text 136B can be derived frc^ a number of 

30 sources including but not limited to closed-captioning 

infcrroationr BP6 material, and text information in the source 
itself (e.g., text in HTWj files). 

The BPG 14 OB contains information related to the source 
material 130B which is useful to the subscriber 120B. The EP6 
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140B Is typically a navigational tool which containa source 
rel&ted Infoxsaation incsluding but not limited to the 
programming category, program description, rating, actors/ and 
duration. The SPG 14 OB can be accesaed by the SCSF 104 by a 
5 request BP6 data eignal 142B which reaulte in the return of a 
category 14 4B, a sub-category 146B, aad a program deaoription 
' 14 BB. The BP6 data nay be stored in memory. 

In another enbodiiaent of the present invention, the source 
irelated text 136B ia the closed-captioning text enibedded in the 

10 analog ot digital video signal. Such cloeed-captioning text 
can be stored in memory for processing to extract character- 
istic vectors 150. 

The SCSF 104 generates one cr more program selection 
records HOB by monitoring and storing activities of the 

15 subsoriber 120B» In an exemplary case, the program selection 
records HOB include time 1128, which corresponds to the time 
of an eventr channel ID 114B, program ID 116B, program title 
117B, volmie level 118B, and channel change record 119b, a 
detailed record of selection data is illustrated latex. 

20 Generally, the program selection records HOB contain the raw 
data accumulated over a predetermined period of time and relate 
to viewing selections made by the subscriber 120B over the 
predetermined period of time. 

!rhe system of the present invention also comprises one or 

25 more filters 115A, IISB. The filters 115A, 115B evaluate the 
advertisement and program selection data and eliminate any 
selection data associated with irrelevant activities, and in 
turn generate actual subscriber selection data 199 that 
corresponds only to the actual viewing selections made by the 

30 subsoriber 120B. !Fhe filters llSAi USB may be a coniputer 
means cr a software module configured with some predetermined 
rules. These predetermined rules assist in recognizing 
Irrelevant activities and the elimination of the selection data 
frcsn the raw subscriber selection data. In one embodiment, the 
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selection data asBooiated vflth channel aurfing, channel jun^^ing 
and dead periods la eliminated from the advertisement and 
program aelectlon data to generate actual subacriber selection 
data 199. FIQ* ID aod the related text describe this proceaa 
5 in detail. 

The actual subsorlber selection data 199 comprisea time 
112Cf which corresponds to the time of an actual viewing event 
exclusive o£ channel surfingr channel junking or dead periods, 
channel ID ll^C, program ID 116C, program title X17C, volume 

10 level IIBC^ and channel change record 1190 • 

Based on the actual auj^scriber selection data 199| the 
SCSF 104 generates one or more program characterietica vectors 
150 which are comprieed of collected ohaifacteriBticB data 152. 
The ojiaracterifltlcs data 152, which can be used to create the 

15 program characteristics vectors 150, both in vector and table 
form, are examples of source related information which 
repreaent charaoteriatics of the source material (for the 
advertisements and the programs) . The .characteristics vectors 
150 are derived from the source related text 136B and/or from 

20 the BPG 1408 by applying information retrieval techniques. The 
details of this process are discussed in detail later. 

In a preferred embodiment, the characteristics vectors 150 
are lists of values which characterise the programming (source) 
material in accordance to the category 144B, the sub-category 

25 14 6B, and the program description 148B. The present invention 
may also be applied to advertisements, in which cass program 
characteristics vectors contain, as an example, a product 
category, a product sub-category, and a brand naitie. 

As illustrated in PIG. IC, the SCSF 104 uses heuristic 

30 rules 160* The heuristic rules 160, as described herein, are 
composed of both logical heuristic rules as well as heuristic 
rules expressed in terms of conditional probabilities. The 
heuristic ruled 160 can be accessed by the SCSF 104 via a 
request rules signal 162 which results in the transfer of a 
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copy of rules 164 to the 8CSF 104. 

The SCSe 104 AlAQ foms demographic vectors 170 from 
(tonographloa data 172. The program demographic veotora 170 
also represent oharaoterlatlcs of souxoe related Information in 
5 the form of the intended or expected demographics of the 
audience for which the aource material is intended. The 
characteristica Vector 150 ia used ia combination with the set 
of the heuristic rules 160 to define the demographic vectors 
170. 

10 In a preferred embodiment, household viewing data 197 is 

coxD|iuted from the actual aubscriber selection data 199. The 
household vievfing data 197 is derived ircn the actual 
subscriber selection data 199 by looking at viewing habita at a 
particular time of day over an extended period of time, usually 

15 several days or weeks, and making some generalizations 

regarding the vievlng habits during that time period. The SCSF 
104 also tranaforma household viewing data 197 to form 
household viewing habits 195, i.e. statistical representation 
of subaoriber/household viewing data illustrating patterns in 

20 viewing. 

The SCSF 104 generates household profiles including a 
household demographic characteristics 190 and a household 
Interest profile 180. Tttm hogsebold demographic 
characteristics 190 resulting from the transfer of household 

25 demographic data 192, and the household Interest profile IBO, 
results from the transfer of household Interests data 162, 
Both the household demographics eharaoteristics 190 and the 
household interest profile 180 have a session value and an 
average value, as will be discussed heraio. 

30 Referring now to FIG. ID, exen^lary proceaaing of the 

filters 115 is shown. As mentioned before, filters 115A and 
filter 115B evaluate the advertisement selection data llOA and 
the program selection data llOB to determine any data 
associated with irrelevant selection activities and then 
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generate actual eubacriber aelection data 199 which doea not 
include irrelevant selection data. The irrelevant selection 
data generally correaponda to channel surfingf channel junplngr 
or dead perloda activities. These activities are generally 
5 recognized by reviewing corresponding viewing times., in the 
case of channel surfing or channel juaqpingf the assooiatedl 
viewing times are very brief, a few milli seconds or a few 
seconds* In the case of dead perlodSr the viewing, time is 
relatively long having no actions r e.g., a few hours. 

10 FIG, 2 illustrates an exemplary system for monitoring 

subscriber activities r Including advertising viewing habits, 
and oaji be used to realize the AM3 1D2 and the SCSF 104. In a 
preferred eitibodiment, the monitoring system of PIG. 2 ie 
located in a television set-top device ox in the television 

15 itself. In an alternate embodljmenti the monitoring system is 
part of a computer which receives programming from a network. 

In an application of the system for television Bervices, 
en input connector 220 accepts the video signal coming either 
from an antennar oable television input, or ether network. The 

20 video signal can be analog or digital ^ such as VSEGn 

Alternatively, the video source may be a video stream or other 
multimedia stream from a communications network including the 
Internet. 

In the case of either analog or digital video, selected 
25 fields are defined to carry BPS^'data or closad-captloning textr 
For analog videor the closed-captionlng text is embedded in the 
vertical blanking interval (VBI). As described in OS Patent 
5,579,005, assigned to Scientific-Mlanta, Inc«^ the BF6 
information can be carried in a dedicated channel or embedded 
30 in the VBI* For digital video, the closed-captioning text is 
carried as video subscriber bits in a subsoriber^data field. 
The EPG data is transmitted as ancillary data and is 
multiplexed at the transport layer with the audio and video 
data. 

25 
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In FIG. 2f A dyatem control unit 200 receives coirffnanda 
fxc^ the subscxlber 120, ddCQdes the command and forwards the 
contmand to the destined module. In a preferred embodiment i the 
commands are entered via a remote control to a remote receiver 
5 205 or a set of seieotion buttons 207 available at the front 
panel of the eyetem control unit 20O. In w alternate 
eiDbodimenti the eubscriber 120 entera the commands via a 
keyboard. 

The system control unit 200 also contains a Central 

10 Processing Unit (CPU) 203 for processing end supervising all of 
the operations of the system control unit 200, a Read Only 
Memory (ROM) 202 oontaining the software and fixed datSr a 
Random Accdss Memory (RAN) 204 for storing data. The CPU 203, 
the RAM 204, the ROM 202, and an input/output (I/O) controller 

IS 201 are attached to a master bus 206. A power supply in the 
form of a battery can also be Included in the system control 
unit 200 for backup in case of power outage. 

The I/O controller 201 interfaces the system control unit 
200 with external devices. In a preferred ezobodiment, the I/O 

20 controller 201 interfaces to the remote receiver 205 and a 
selection button such as the channel change button on a remote 
control. In an alternate embodiment/ it can accept input from 
a keyboard or a mouse. 

The program selection data is forwarded to a channel 

25 procesBOr 210. The channel processor 210 tunes to a selected 
channel and the media stream is decomposed into its basic 
components: the video stream, the audio stream, and the data 
stream. The video stream is directed to a video processor 
module 230 where it is decoded and further processed for 

30 display to the TV screen. The audio stream is directed to an 
audio processor 240 for decoding and output to the speakers • 
The data stream can be BP6 data, closed-captioning text, 
Extended Data Service (EDS) information, a combination of 
these, or an alternate type of data. In the ease of BDS the 
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call elgnr program name aad other useful data are provided. In 
a preferred embodiment, tbe data etxeam is stored in a reserved 
looation of the ¥M 204. In an alternate embodiment, a 
magnetic diek is used for data storage. The system control 
5 unit 200 wrltee in a dedicated memory, which in a preferred 
embodiment ia the 'RAM 204, the selected channel, the tiine of 
selection, the volume level and the program ID and the program 
title. Upon recelv'ing the program selection data, the new 
selected channel is directed to the channel processor 210 and 

10 the system cdntrol unit 200 writea to the dedicated memory the 
channel selection end time and the program title at the time of 
channel change • The system control unit 200 keeps track of the 
number of channel changes occurring during tbe viewing time via 
the channel change record. This data forms part of the 

15 advertising selection records llOA or the programming selection 
records 11 OB. 

The volume control signal is sent to the audio processor 
240. In a preferred embodiment/ the volume level selected by 
the subscriber corresponds to the listening volume ^ In an 

20 . alternate embodiment, the volume level selected by the 
subscriber represents a volume level to another piece of 
equipment such as an audio system (home theatre system) or to 
the television itself. In such a case, the volume can be 
measured directly by a microphone or other audio sensing device 

25 which can monitor the volume at which the selected source 
material is being listened. 

. A program change occurring while watching a selected 
channel is also logged by the system control unit 200. 
Monitoring the content of the program at the time of the 

30 program chhnge cen be done by reading the content of the EDS. 
The EDS contains information such as program title, whicdi is 
transmitted via the VBI , A change on the program title field 
is detected by the monitoring system and logged as an event » 
In an alternate embodiment, an EP6 is present and program 
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Infortn&tion can be extxacbed from the SPG. In a pxefexzed 
eiQbMiR«ntr ptogranialiig data received itm the SDS or BP6 
pexmlts distinguishing between entertainment prograiAming and 
advextisements. 

S FIG. 3 lllustrdtes an exesiplaxy blook diagram of the 

channel processor 210. in a pxefexxed einbodlment/ the input 
connector 220 connects to a tuner 300 which tunea to the 
selected channel. A local oacillator can be used to betexcdyne 
the signal to the IF signal. A deotodulator 302 demodulates the 

10 reoeirecl signal and the output Is fed to an FBC decoder 304. 
The data atream received from the FBC decoder 304 is, in a 
preferred embodittkent, in an HPE6 format. In a preferred 
exDbodlment, a system demultiplexer 306 separates out video and 
audio infonnation for suSseguent deconq;>reaaion and proceaalngr 

15 as well as ancillary data which can contain program related 
information » 

The data stream presented to the system demultiplexer 306 
consists of packets of data including video, audio and 
ancillary data. The system demultiplexer 306 identifies each 

20 packet from the stream 10 and directs the stream to the 
corresfjonding processor. The video data is directed to the 
video proc^sisor module 230 and the audio data is directed to 
the audio processor 240. The ancillary data can contain 
closed'-captioning text, emergency messages, program guide, or 

25 other useful iatodtation. 

Closed-cap tioning text is considered to be ancillary data 
and is thus contained in the video stream. The system 
demultiplexer 306 accesses the subscriber data field of the 
video stream to extract the olosed-oaptioning text. The 

30 program guide, if preaentr is carried ,on data stream identified 
by a specific transport program identifier. 

In an alternate embodlmentf analog video may be used. For 
analog programming, ancillary data such as closed-captioning 
text or EDS data are carried in a vertical blanking interval. 
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PIG, 4 Illustrated an exemplary block diagram of a 
computer syatem for a realization of the subscriber monitoring 
system illuat rated in P1Q.2. A system bus 422 traneporte data 
amongst the CPU 203/ the RAM 204, a Read Only Memory - Basic 
5 Input Output System (ROM-BIOS) 406 and other oomponenta. The 
CPO 203 deceases b hard drive 400 through a disX controller 
402. The standard input/output devices are connected to the 
system bus 422 through the I/O controller 201. A keyboard is 
attached to the I/O controller 201 through a keyboard port 416 

10 and the monitor is connected through a monitor port 41B. The 
serial port device uses a eerial port 420 to cononunicate with - 
the I/O controller 201. Industry Standard Architeoture (ISA) 
expansion elote 40B and Peripheral Component Interconnect (PCI) 
expansion slots 410 allow additional cards to be placed into 

15 the computer. In a preferred embodiment r a network card is 
available to interface a local area/ wide areai or other 
network. 

PIG. 5 illustrates a channel sequence and volume over a 
twenty-^four (24) hour period associated with advertisement 

20 selection record llOA or subscriber selection record HOB. The 
Y-'axis represents the status of the receiver in terms of on/off 
status and volume level. The X-axis represents the time of 
day. The channels vie^^ed are represented by the windows 501- 
506i with a first channel 502 being watched followed by the 

25 viewing of a second ohanoel 504, and a third channel 506 in the 
morning. In the evening a fourth channel 501 is watched, a 
fifth channel 503, and a sixth channel SOS. A channel change 
is illustrated by a momentary transition to the ^off" status 
and a volume change ia represented by a change of level on the 

30 Y-axis. 

A detailed record of the advertising selection record llOA 
and/or programming selection data llOB is illustrated in fig, 
6A in a table format. A time column 602 contains the starting 
time of every event occurring during the viewing time. A 
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Channel ID eolunin 6Q4 lists the duinnels viewed or visited 
during that period. A title column 603 contains the titles of 
prograna/advertleeAentB viewed. A volume column 601 contains 
the volume level et the tine of viewing A eelected channel. 

GeDdzally, the advertlBement selection record llOA and/or 
progxan selection record LlOB are unprocesaed data and 
con^rlees the data associated with irrelevant or 
Inconsequential activities, e.g., channel surfing, channel 
jumping, or dead activities. Thus, before the subaoriber/ 
household viewing habits are determined, the raw selection data 
18 filtered to eliminate the data associated with irrelevant 
(inconsequential) activities such as channel aorflng, channel 
jumping, or dead period activities. Zt la to be noted that raw 
aeleotion data refers back to advertisement Boleotion records 
llOA and program selection records HOB. 

As illustrated In FIG. 6B, the channel surfing relates to 
an activity wherein the subscriber rapidly changes channels 
before, arriving at a channel which nay be of interest to bin. 
During the channel surfing period, the viewing time of each 
intermediate channel is very brief, e.g., less than one minute. 
In this viewing time, the subscriber briefly glances at the 
channel pzogranndng, and then moves on to the next channel. 

One or more filters of the present invention are 
configured to filter -out the surfing activity and only the 
actual viewing activity la considered In the actual malce-up of 
household viewing habits. For example, in FIO. 68, the viewing 
record illustrates that the viewing time of each of the 
channels 2, 3, 4, 5 is less than a minute, however, the viewing 
time of channel 6 is about an hour. Filter 115 of the present 
inveation evaluates this record, and then removes the 
corresponding viewing times of channel 2, 3» 4* 5, from the 
viewing records. The viewing time of channel number 6 is kept 
as it is not indicative' of the channel surfing, , but an actual 
viewing. 

ff 
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similarly, the viewing record also indicatea that the. 
corresponding viewing timea of eaoh of channel nvmbera 7, 8, 9, 
Sif 51 f 56r 55, 54r 53 are about a minute or lesa. Thia 
iflnpliea that after the subaeriber had completed the viewing of 

5 channel nunbex 6, the aubacriber oiice again surfed the channela 
to find a progranming of interest at channel 25, which vaa 
viewed for about 10 minutee. 

136. 60 illuatratea proceaaing involved in the elimination 
of viewing times associated with the channel jumping 

10 activities. The channel jumping activity is different than a 
channel surfing activity in a sense that the subscriber^ already 
Xnowd the intended programming (and corresponding channel 
. number) he wants to watch^ and utilizes the channel up or 
channel down button to arrive at the intended channel. 

15 The viewing time of all the intermediate channels during 

channel jumping activity are generally very brief (lees than a 
second} . Also^ as the channel up or channel down button is 
utilized to reach the desired channels/ generally, there exists 
an upwards or a downwards stream of channel changes^ i.e., the 

20 subscriber may jump tbrough. channels 2 ^ 3, 4 and 5 to reach 
channel nuxciber 6 (an intended channel) . Similarly, subscriber 
jumps may through channel 7, B, 9; I0| 11, 12, 13, 14, 15, and 
16 to reach channel 17. 

The filters of the present invention are configured to 

25 elindnate the channel junq^ng dJsita from the actual viewing 
data. Filtere generally evaluate the associated viewing times, 
and all the viewing times which correspond to channel Juiqping, 
e.g,, are less than one second, are removed from the viewing 
records. 

30 The filters are also configured to eliminate data 

associated with dead actlvit lea, e^g,, extended spans o£ 
inactivity. These extended spans of inactivity Indicate that 
the subaoriber is not actively watching the programming, e.g., 
the subscriber has left the room, has gone to sleep, or is 
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Otherwise engaged in gome other activity* These spans of ^ 
inactivity may be determined by evaluating channel ohange 
coramandfi, voltune ohange commanda, or other program selection 
ooiMianda ieaued by the eubecriber. For example^ if the 
5 evaluation of the viewing record indicates that, the subscriber 
has not isaued either of the channel changOi volume change, 
on/of £, or any other program selection command in laat three 
hourfii it id aasumed that eubscriber is in an inactive 
condition^ and the remaining viewing time of that viewing 

10 aeeeion ie not considered in the make-up of the household 
viewing habits » The spans of inactivity may be caused by any 
nurtiber of reasons* For example, it is generally known that 
aubscribers often do not turn their televisions (or other 
multimedia sources) off before attending to eome other 

15 activities, e.g. cooking in the Icitchen, running to the nearby 
grocery store, or going to basement for a work^-out. 

The filters of the present invention are constantly 
filtering out the irrelevant infoncvation associated with the 
channel surfing activities, channel jisi^ing activities, or with 

20 the periods of inactivity, so that the data used for generating 
household viewing habits is more illustrative of the actual 
viewing habits. The actual subscriber selection data is then 
used to create household viewing habits. 

A representative statistical record corresponding to the 

25 household viewing habits is illustrated in FIG. 7. In a 

preferred embodiment^ a time of day column 700 is organized in 
period of time including morning, mid-day, afternoon^ night, 
and late nighk. In an alternate embodiment/ smaller time 
periods are used. A minutes watched column 702 lists, for each 

30 period of time, the time in minutes in which the 8C5F 104 
• recorded delivery of programming. The number of channel 
changes during that period and the average volume are also 
included in that table in a channel changes column 704 and an 
average volume column 706 respectively. The last row of the 
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Statistical reoord contains tA© totals for the itsjiis listed in 
the niotttes vatcihed column 702, the channel' ohangea coluam 704 
and the average volume. 7 06. 

PIQ. 8 A llluBtxatea an entity-relafcionahip diagram for the 
5 generation of the charactexistlca veotoz 150. The context 
vector generation and retrieval technique can be applied for 
the generation of the chazadteriatice vectors 150 which ia 
described in OS Patent 5/619,709. Other technigqes are well 
knovm by those skilled in the art. 
10 The source material 130 or the QPG 140 is passed through a 

characterization processing 600 to generate the oharactezlBtics 
vectors 150. The oharaoterization processing 800 is described 
in accordance with FIG. 8B. The content descriptors including 
a first content descriptor 802, a second content descriptor 804 
15 and an nth content descriptor 806, each classified in terms of 
the category, the sub-category, and other divisions as 
identified in the industry accepted program classifioation 
system, are presented to a context vector generator 820. As an 
exan^le, the content descriptor can be text representative of 
20 the expected content of material found in the particular 

category (program and/or advertisement) . In this example, the 
content deecriptors 802, 804 and 806 would contain text 
representative of what would be found in programs in the news, 
fiction, and advertising categories respectively , The context 
25 vector generator 820 generates -context vectors for that set of 
aanple texts resulting in a first sunonary context vector 808, a 
second suBimary context vector 810, and an nth sunuaary context 
vector 812 . In the example given, the sommary context vectors 
808, 810, and 812 correspond to the categories of news, fiction 
30 and advertising respectively. The sumrory vectors are stored 
in a local data storage system. 

K saiQile of the source related text 136 which is 
associated with the nev program to be classified is passed to 
the context vector generator 820 which generates a context 
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Victor B40 for that program, The aouroe related text oan be 
either the source material 130, the BPG 140/ oi other text 
associated with the eovrce material 130. A coe^parison is made 
between the actual program context vectors and the stored 

5 program content context vectors by computlngi in a dot product 
ccHoputation process 630, the dot product of the first sumnvary 
context vector 808 with the context vector 940 to produce a 
iiiBt dot product 814, Similar operations are performed to 
produce second dot product 816 end nth dot product 818. 

10 ' The values contained in the dot products 814, 816 and 81 8 , 
while not probabilistic in naturer can be expressed in 
probabilistic terms using a simple transformation in which the 
result represents a confidence level of assigning the 
corresponding content to that program^ The transformed values 

15 add up to one# fThe dot products can be used to classify a 
program, or form a weighted sum of classifications which 
results in the characteristics vectors » In the example given, 
if the source related text 136 wee from an advertisesnent, the 
nth dot product 618 would have a high value, indicating that 

20 the advertising category was the loost appropriate catecfory, and 
assigning a high probability value to that category. If the 
dot products corresponding to the other categories were 
significantly higher than zero, those categories would be 
aesigaed a value, with the result being a program 

25 charaoterist&os vector 150 as shown in FIG. 9D. 

For the sub- categories, probabilities obtained frcn the 
content pertaining to the same sub^oategory are summed to form 
the probability for the new prograiti being in that Bub«-category» 
At the sub-category level, the same method is applied to 

30 compute the probability of a program being from the given 
category. The three levels of the program classification 
ayatem; the category/ the sub-category and the content^ are 
ueed by the characterisation processing 800 to form the 
characteristics vectors. 
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The program oharaoteristlcs vdctor? 150 In gendral are 
represanted in FIGS. 9A through 9F. FIG8« dk, 9B and 9C are an 
exaaple of detexmlnlstio veotors. This aet of veotora ia 
generatecl when the program charaoterlstloa axe well defined, aa 
5 can occur when the source related text 136 or the BPG 140 
contains specific fields identifying the category and the eub- 
category. A program rating can also provided by tha BPQ 140. 

In the caee that these character i at ice are not epecifiedr 
a statistical aet of vectors is generated from the process 

10 described in accordance with FIG. B. FIGS. 9D-9F illustrate 
the probability that a program being watched is from the given 
category and program classification^ respectively. 

PIG. lOA illuetrates sets of logical heuristics rules 
which form part oC the heuristic rules 160. In a preferred 

15 embodiment, logical heuristic rules are obtained from 

sociological or psychological studies. Two types of rules are 
illustrated in FIG. lOA. The first type links an individual's 
viewing characteristics to deirographic characteristics such as 
gender, age^ and income level. A channel ohanging rate rule 

20 1030 attempts to determine gender based on channel change rate. 
An income related channel change rate rule 1010 attempts to 
link channel change rates to income brackets. A second type of 
rules links particular programs to particular audience, as 
illustrated by a gender determining rule 1050 which links the 

25 program category/Bub*-category with a gender. The rasult of the 
application of tbe logical heuristic rules illustrated in FIG. 
IDA are probabilistic determinations of factors including 
gender^ age, and income level. Although a specific set of 
logical heuristic rules has been used as an exanpler a wide 

30 nuKtiber of types of logical heuristic rules can be used to 

realize the present invention. In additionr these rules can be . 
changed based on learning within tbe system or based on 
e)(ternal studies which provide more accurate rules. 
PIG, lOB illustrates a set of the heuristic rules 
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expreesed in terfii3 of conditional prbbablXitlea. In the 
example ehovn io TIQ^ lOB^ each of deveral categoried have 
associated conditional probabilities? for demographic factors 
such as age, income, fandly size and gender c<»(^odition. 

5 PtG. 11 illustrates an entlty-relationehip diagram for the 

generation of the deraographic vectors 170. In a preferred 
enibodimentr the heuristic rules 160' are applied along v^ith' the 
chaxacterletic veotora 150 In a target analysis procdSd 1100 to 
form the demographic vectors 170. The charaotezistlc vectors 

ID 150 indicate a particular aspect of a progranif such as its 
violence level. The heuristic rules 160 indicate that a 
particular demographic group has a preference for that program. 
As an exanpler it nay be the case that young males ba've a 
higher preference for violent programs than other sectors of 

15 the population. Ihua^ a program which has the obaraoterlstic 
vectors 150 indicating a high probability of having violent 
content/ when cc»dbined vith the heuristic rules 160 indicating 
that ^^young males like violent programs/' will result ^ through 
the target analysis process 1100, in the demographic vectors 

20 170 which indicate that there is a high probability that the 
program is being watched by a young male* 

Ihe target analysis process 1100 can be realized using 
software programmed in a variety of languages which proceasee 
xaathematically the heuristic rules ISO to derive the 

25 demographic vectors 170. The table representaticn of the 
heuristic rules 160 llluetcated in FIG. lOB expresses the 
probability that the individual or household is from a specific 
demographic group based on a program vith a particular 
category. ^This can be expressed, using probability terms as 

30 follow "^the probability that the individuals are in a given 
demographic group conditional to the program being in a given 
category". 

Expressing the probability that a program is destined to a 
specific demographic group can be determined by applying Bayes 
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rule. This probability Is the ovon of the conditianal 
probabilities that the demographic group likee the progrant, 
conditional to the category 144 weighted by the probability 
that the program la from that category 144. In a preferred 

5 eokbodiment, the program target analyala can calculate the 
program demographic veotore by the application of logical 
heuriatio rules 160, as iiluetrated in FIG. lOA, and by the 
application of heuristic rulea expreeeed aa conditional 
probabilitiee as shown in FIG. lOB. Logical heuristic rules 

ID can be applied ueihg logical programming and fuzzy logic using 
techniques well understood by those sXilled in the art; and are 
discussed in the text by 8, V. Kartalopoulos entitled 
''Understanding Neural Networks and Furzy Logic. ^ 

Conditional probabilities can be applied by simple 

15 mathematical operations multiplying program context vectors by 
matrices of conditional probabilities » By performing this 
process over all the demographic groups, the target analysis 
process 1100 can measure how likely a program is to be of 
interest to each demographic group. Those probabilities values 

20 form the demographic vector 170 represented in FIG, 12. 
As an exaiq>le, the heuristic rules expressed as 
conditional probabilities shown in FIG. lOB are used as part of 
a matrix multiplication in which the program characteristica 
veotor 150 of dimension such as those shown in FIGS. 9A-dF 

25 is multiplied by an N x M matrilt of heuristic rules expressed 
as conditional probabilities r such as that shown in FIG. lOD. 
7he' resulting veotor of dimension H is a weighted average of 
the conditional probabilities for each category aod represents 
the household demographic characteristics 190. Similar 

30 processing can be performed at the sub-category and content 
levels. 

FIG. 13 illustrates an entity-relationship diagram for the 
generation of household session demographic data 131D and a 
household seasion interest profile 1320. In a preferred 
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erobodimenti the actual oubscrlbar selection data 199 is Ufifed 
along with the program char act eriatics vectors 150 in a aeaelon 
characterizatloa proceaa 1300 to generate the household seaaion 
interest profile 1320. The actual aubaoriber selection data 
5 159 Is baaed upon one or more advertisement selection records 
and indicates ti^hich advertiaementa the aubaoriber is watching^ 
for how long and at what volume they are watching. Similarly/ 
the actual subsotiber aeleotion data 199 alao indicatea which 
programs subscriber is watching, for how long and at what 

10 volume they are watching the program. 

In a preferred. Pediment r the session characterization 
process 1300 forms a weighted average of the program 
characteristics vectors ISO in which the time duration the 
program is watched is normalized to the session time (typically* 

15 defined as the time from which the unit was turned on to the 
present) . The program obaraoteriatica vectors 150 are 
multiplied by the normalized time duration (which is less than 
one unless only one program. has been viewed) and summed with 
the previous value. ' Time duration data/ along with other 

20 subscriber viewing information ^ is available from the 
subscriber selection data llOA and HOB. The resulting 
weighted average of program characteristics vectors 150 forms 
the household sesaion interest profile 1320r with ea?h program 
contributing to the household seaaion interest profile 1320 

25 according to how long it was watched. The household session 
Interest profile 1320 is normalized to produce probabilistic 
values of the household programming interests during that 
session. 

In an alternate embodiment r the heuristic rules 160 are 
30 applied to both the actual subscriber selection data 199 and 
the characteristics vectors 150 to generate the household 
sessioQ demographic data 1310 and the household session 
interest profile 1320. In this embodimentr weighted averages 
of the characteristics vectors 150 are formed based on the 
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actual aubsoriber selection data 19 9| and the heuristic arules 
160 are applied. In the oaoe of logical heuristic rulea aa 
ahown in FIG. lOA, logical prograiaming can be applied to make 
determinations regarding the household aesaion demographic data 

5 1310 and the household seaaion interest profile 1320, in the 
case of heuristic rules In the foxm of conditional 
probabilities such ae those illustrated in no. lOB, a dot 
product of the time averaged values of the program 
characteristics vectors 150 can be taken with the appropriate 

10 matrix of heuristic rules ISO to generate both the household 
seaaion demographic data 1310 and the household session 
interest profile 1320. 

Volume control measurements which fom part ot the 
subscriber selection data llOA and llOB can also be applied in 

15 the session characterisation process 1300 to formed household 
aasaion interest profile 1320. This can be accomplished by 
using normalized volume measurements in a weighted average 
manner aimilar to how time duration ia used. ThuSr muting a 
show results in a zero value for volwe, and the program 

20 characteristics vector 150 for this show vfill not be averaged 
into the household session interest profile 1320. 

Fie. 14 illuetrates an entity-relationship diagram for, the 
generation of average household damographic characteristics L90 
and- session household demographio characteristics 190. A 

25* household denK>grdphic characterization process 1400 generates 
the household demographic characteristics 190 represented in 
table format in FIG. 15. The household demographic 
characterisation process 1400 uses the household viewing habits 
195 in combination with the heuristic rules 16D to determine, 

3D demographic data. For exaniple/ a household with a number of 
minutes watched of zero during the day may indicate a household 
with two working adults. Both logical heuristic rules aa well 
as rules based on copditional probabilities can be applied to 
the household viewing habits 195 to obtain the household 
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dentogxaphlcs chaKacterlstlcs 190. 

Tbe household viewing habits 195 is also used by the 
system to detect out-of -habits events. For example, if a 
household with a zero value for the minutes watched column 702 
S at late night presents a session 7alue at that time via the 
household session demographic data 1310, this session will be 
characterized as an out-of -habits event and the system cm 
exclude such data from the average if it is highly probable 
that the demographics for that aession axe greatly different 
10 than the average demographics for the household. Nevertheless, 
the results of the application of the household demographic 
diaraotarization process 1400 to tbe household session 
demographic data 1310 can result in valuable sessioa 
demogr^uphic data, even if such data is not added to the average 
15 demographic characterization of the household. 

FIG. 15 illustrates the average and session household 
demographic characteristics 190. A household demographic 
parameters oolutm 1501 is followed by an average value column 
ISOSr a session value column 1503, and an tipdate column 1507. 
20 The average value column 1505 and the session value column 1503 
are derived fr^ the household demographic characterization 
process 1400. The detemiulstic parareeters buiA as address and 
telephone nMunbers can be obtained from an outaide source or can 
be loaded into tbe system by the subscriber or a network 
25 operator at the time of installation. Opdating of 

deterministic values la prevented by indicating that these 
values should not be updated in the update column 1507. 

PIG. 16 illustrates an entity-relationship diagram for the 
generation of the household interest profile 180 in a household 
30 interest profile generation process 1600. In a preferred 
embodiment, the household interest profile generation process 
1600 ocDiprises averaging the household session interest profile 
1320 over multiple sessions and applying the household viewing 
habits 195 In combination with the heuristic rules 160 to form 
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the household interest profile 180 which takes into aooouot 
both the viewing preferences of the household as weU as 
asaumptione about houBeholds/subscribers with those viewing 
babita and program preferences. 

5 £"16. 17 illustrates an exesnplary houaehold interest 

profile 180 that includes a programming types row 1709, a 
products types row 1707, a household interests column 1701, an 
average value column 1703, and a session value column 1105. 
The product types row 1707 gives an indication as to what 

10 type of advertisement the household would be interefted in 
watching, thus indicating what typea of products could 
potentially be advertised with a high probability of the 
advertisement being watched in its entirety. The programming 
types row 1709 suggests what kind of programming the household 

15 is likely to be interested in watching^ The household 

interests column 1701 specifies the types of programcving and 
products which are atatistically characterized for that 
household. 

As an example of the industrial applicability of the 
20 invention^ a household will perform its normal viewing routine 
without being requested to answer specific questions regarding 
likes and dislikes. Children may watch television in the- 
morning in the household/ and may change channels during 
commercials/ or not at all. The television may r^ain off 
* 25 during the working day, while the children are at school and 
day care, and be turned on again in the evening, at which time 
the parents may ''surf'' channels/ mute the television during 
commercials, and ultimately watch one or two hours of broadcast 
progranming. The present invention provides the ability to 
30 characterise the household, and may make the determination that 
there are children and adults in the household, with program 
and product interests indicated in the houaehold interest . 
profile IBO corresponding to a family of that con^^osition. A 
houaehold with two retired adults will have a completely 
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different oharaotarization which will be Indicated in the 
household interest profile 180. 

Since a viewing session ie likely to be dominated by a 
particular viewer^ the session values my^ in some 

S circmostanoesr correspond most closely to the subs^criber 
valueSf while the average values my, in some circumstances, 
correspond n^oet closely to the household values. The average 
value being a time average of data^ where the averaging period 
may be several days, weeks, monthe, or the time between reaeta 

10 of unit. 

Although the present invention has been largely described 
in the context of a single confuting platform receiving 
progrannding, the AMPS 100 can be realized as part of a client- 
server architecture, as illustrated in PIG. 10. Residence IBOO 

15 contains a personal con^uter (PC) 1820 as well as the 

combination of a television 181D and a set-top box 18 DB, which 
can request and receive prograinming. The equipment in 
residence 1600, or aindlar equipoient in a small or large 
buainesa environment/ forma the client side of the network as 

20 defined herein < Programing is delivered over an access 
network 1830^ which my be a cable television networki 
telephone type network f or other access network. Information 
requests are made by the client side to a server 1840 which 
forms the server side of the network. The server 1640 has 

25 content locally which it provides to the evbsoribex/ or 

requests content on behalf of the subscriber from a third party 
content provider 1660r as illustrated in FI6» 18. Requests 
made on behalf of the client side by server 1840 are made 
across a wide area network 1650 which can be the Internet or 

30 other publio or private network. Techniques for making 
requests on behalf of a client axe frequently referred to a 
proxy techniques and are well known to those skilled in the 
art. The server side receives the requested programming which 
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ia displayed on PC 1820 or television 1810 eccording to which 
device made the request. 

According to one'enbodiment, the server side meintalna the 
advertising selection data llOA and subscriber selection data 

5 HOB which it is able to compile based on its operation as a 
proxy for the client side. Retrieval of source related 
information 130^ the program target analysis process llOOi the 
program characterization process BOO, the session 
characterizatiorf process 1300 , the household demographic 

10 characterization process 1400, and the household interest 
profile generation process 1600 can be performed by server 
1840. 

Referring to PIG. 19 an advertisement monitoring table is 
illv^trated, in which an advertisement ID (AD ID) column 1915 

15 contains a numerical ID for an advertisement which was 

transmitted with the advertisement in the form of a Program ID, 
http address r or other identifier which is uniquely associated 
with the advertisement. A product column 1921 contains a 
product description which indicates the type of product that 

20 waa advertised. A brand column 1927 indicates the brand name 
of the product or can alternatively list a generic name for 
that product. A percent watched column 1933 indicates the 
percentage of the advertisement the subscriber viewed. In an 
alternate embodiment^ a letter rating or other type of rating 

25 ia used to indicate the probability that the advertisement was 
watched. A volume column 1937 indicates the volume level at 
which the advertisement was watched. 

As an example of the industrial applicability of the 
invention, a manufacturer may develop an advertising strategy 

30 which includes the Insertion of advertisements during popular 
evening programs. The costs for such ad insertions can be 
extremely high. In order to insure the cost effectiveness of 
this advertising strategy, the manufacturer has the 
advertisements placed during less watched but similar programs 
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. and oonltoxs hot; subscrlberfi react, and can detexmine 
approximately how oaoy timea the advertisement haa been watched 
out of all of the possible vlewings. This data can ba used to 
confirm the potential effeotiveness of the advertisement and to 
subsequently determine if purohaeing the more expensive time 
during evening programming will be ooat-effeotiv©^ or if the 
advertisement should be modified or placed in other 
programming. 

Continuing this example, the rnanufaoturer nay place an 
advertisement fofc viewing during *prime tine** for an initial 
period but Cah subsequently cancel broadcasts of the 
advertisement if it is found that the mjority of subscribers 
never see the advertisement. 

Although this invention baa been illustrated by reference 
to specific embodiments, it will be apparent to those sldlled ' 
in the art that various changes and modifications may be made 
which clearly fall within the scope of the invention. The 
invention is intMided to be protected broadly within the spirit 
and soope of the appended claims. 
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Nhat is olaimed is; 

1, A method for generating a sisbsorlber profile based on 

advertlssitenta watched by the BUbsoriber, the method 
5 coQiprislng; 

monltoriag Bubacxlber advertising viewing aotivlties; 

collecting advertlsemeat aelectlcn data from the monitored 
subBoriber advextising viewing activities; and 

generating a subscriber profile based on the advertisement 
10 selection data. 

2. The method of claim 1, further cQmpxising retrieving 
advertisement related information for advertisements identified 
in the advertisement seleotion data wherein the advertisement 

15 related information contains descriptive fields related to the 
advertisements. 



3. The method of claim wherein said retrieving 
includes context mining text associated with the 

20 advertisements. 

4. The method of claim 3^ wherein the text is derived 
from closed-captioning data aasociated with the advertisement. 
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5. Tbe method of claim 3, wherein the text includes a 
product name field. 



6. The method of olaim Z, whexeln the text inoludes a 
product bxand field. 

.7. The method of olela 1, wherein said monitoring 
subeoriber advertising viewing activities includes monitoring 
volume levels. 

8. The method of claim 1, wherein said monitoring 
subBoriber advertising viewing activities includes monitoring 
channel change requests by the subsoriber. 

9. Tbe method of claim 1, wherein said collecting 
advertisement selection data inoludee determining the extent to 
which an advertis^nent is viewed by the subsoriber . 

10. The method of claim 1, wherein the subscriber profile 
is a subscriber product interest profile. 

11. The method of claim 1, further includes: 

moAitoring subscriber program viewing activities; 
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collecting program selection data for the monitored 
subscriber program viewing activities; 

combining the program aelectlon data with the 
adhrertisBinent aelectlon data; 

. evaluatiJig the combined program selection data and the 
achrertlsemeat selection data to filter out Irrelevant data and 
generate a record of actual subacribar selection data; and 

proceeeing the actual dubacriber selection data to create 
the subscriber profile. 

12. The method of claim 11, wherein said monitoring 
subscriber program viewinig activities includes monitoring 
viewing time durations for selected source material, 

13. The method of claim 11/ wherein said evaluating the 
combined program selection data includes evaluating channel 
change commands and associated viewing times. 

14. Ihe method of claim 13r wherein aaid evaluating the 
combined program selection data includes filtering out any 
channel change commands if the aeaooiated viewing times are 
below a pre-^determined threshold. 
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15. tDhe method of olaim 14/ wherein the filtered out 
channel change conmands correspond to channel surfing 
activitiee. 



16/ The method of claim 14, wherein the filtered out 
channel cthange commands correspond to channel jumping 
activities. 



17. The method of claim* 11, wherein said evaluating 
includes evaluating viewing times and filtering out any viewing 
periods if no subscriber activity has been received within a 
pxe^determined period of time. 

18. The method of claim 17, wherein the filtered out 
viewing periods correspond to dead periods implying that the 
subscriber ia not actively watching a television or other 
multimedia device. 

19. The method of claim 11, wherein the subscriber 
profile is a program preference profile for the eubecriberr the 
program preference profile indicating the type of programming 
of Interest to the eubscriber. 
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20. The method of claim 11, wherein the subecrlber 
profile Is a product preference profile for the s^sbeoribexr the 
product preference profile indicating the type of products of 
interest to the eubscrlber. 

5 • 

21. The jnethod of claim 11/ wherein the subscriber 
profile is an advertising preference profile for the 
subscriber, the advertising preference profile indicating the 
type of advertielng of interest to the aubecriber. 

10 

22. A data processing eystem for generating a subscriber 
profile based on adv©rtia«nents watched by the Bubscrlber/ the 
system ooitipriBing} 

a storage medium; 

15 means for monitoring subaoriber advertising activities; 

means for collecting advertisement selection data for the 
monitored subscriber advertising activities; 

means for retrieving advertisement related information for 
ads in the advertlsenent selection data, wherein the 
20 advertisement related information contains descriptive 

fields corresponding to the advertisements/ 

means for determining the extent to which the 
advertisements are viewed by the subscriber; and 
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means for gensrabliig a subscriber profile baaed on the 
advertisement related information and the extent to which the 
advert ieementa are viewed* 

5 23. The eyetem of claim 22, wherein the nteana for 

monitoring subscriber activity includes means for inonitorlng 
'volume levels wherein the volume levels correspond to 
subscriber selection volume levels. 

ID 24. The system of claim 22, wherein the means for 

monitoring subscriber activity includes meana for monitoring 
channel change requests initiated by the subaoriber. 

25. The system of claim 22, wherein the means for 

15 retrieving advertisement related information includes means for 
context mining of textual information associated with selected 
source material* 

26. The system of claim 25, wherein the textual 
20 information is text derived from closed-captioning data 

associated with the advertisement. 
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27. The system of claim 2$, vhexeln the test deciTed from 
closed-captionlng data aesoeiated with the advextlBenient 
inolvdee a product name field. 

I 

5 28. The system of claim 26, wherein the text derived from 

olosed-captioning date aasocieted vlth the advettisefment 
included a product brand field. 

29. The system of claim 22, further comprising; 

10 means for monitoring aubsoribet program viewing 

aotivitleaf 

meana for collecting program aelection data for the 
monltoced subeorlbex program viewing activities; and 

means for coniblning the advertisement aelection data and 
15 the program selection data. 

30. The aystem of claim 2^, further comprlBing: 

means fox filtering out Irrelevant data and generating a 
record of actual eubecxiber selection data^ and 

20 means for proceeslng the actual subscriber selection data 

to create a subscriber profile. 
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31. The system of olalm 22, wherein the subdcriber 
profile io a program preference profile for the eubecriberr the 
program preference profile Indicating the type of prograiMdng 
of interest to the subscriber. 

5 

32 » The system of claim 22^ wherein the subscriber 
profile is s product preference profile for the subscriber, the 
product preference profile indicating the type of products of 
interest to the subscriber* 

10 

33. 1!he' system of claim 22i vherein the subscriber 
profile is an advertising preference profile for ths 

Bubacriber,- the advertising preference profile indicating the 
type of advertising of interest to the subscriber* 

34* A olient-serysr based data processing system for 
generating a subscriber profile based on the advertisements 
watched by a subscriberi the cLient-'server based data 
processing system comprising: 

20 cos^uter processor means at a client side for receiving 

and displaying advertisenaenta and transmitting channel change 
requests; 

c^uter processor means at a server side for receiving 
the channel change requests and for processing data; 

52 

5/4/05, EAST version: 2.0.1.4 



wo 01/69747 TCtfDBnn6iS9 
a storage medium; 

means at the eervec side for noaitorlng aubsorlber 
activity including receiving subscriber channel change requests 
and etcring subscriber channel change requests; 

5 means at the server side for retrieving advertisement 

related information wherein the advertisement related 
information contains descriptive fields corresponding to an 
advertisement; 

means at the server side for determining the extent to, 
10 which, an advert isentent is viewed by the subscriber; 

means at the server side for storing the descriptive . 
fields and the determination of the extent to vhich the 
advertisemsnt is viewed by the subscriber; and 

mesne at the server eide for processing the descriptive 
15 fields and the extent to which the advertisement is viewed by 
the subscriber information to generate subscriber profile. 

35. The system of claim 34 ^ wherein the means for 
retrieving advertisement related information further comprises 
20 means for context mining of textual inforcoation aasociated with 
the selected source material. 
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36* The system of claim 33, whfttslo the textual 
information is text derived from dosed-oaptioning data 
eesoeiated vith the adveartiaement. 

37. The system of claim 36, wherein the text derived from 
dosed-oaptioning data associated vith the adTertisement 
Includes a product name field. 

38. The system of claim 36, wherein the text derived from 
closed-eaptiohing data assooiated with the advertisement 
includes a product brand field. 

39. The system of claim 34, further con^rising; 

means for monitoring subscriber viewing activities related 
to actual programming; 

means ifor collecting program selection data based on the 
actual programming; and 

means for combining the advertisement selection data and 
the program selection data. 

40. The system of. claim 34, further comprising: 

means for filtering out irrelevant data and generating a 
record of actual subscriber selection data; and 
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means fox processing the actual subsoxlber selection data 
to create a eubaoriber profile. 



41. The system described in claim 34r wherein the 

5 subscriber pro£ile is a program preference profile for the 
subscriber, the program preference profile indicating the type 
of programming of interest to the subscriber t 

42. The system of claim 34/ wherein the subscriber 

ID profile is a product preference profile for the subscribei:^ the 
product preference profile indicating the type of products of 
interest to the subscriber. 

43* The system of claim 34, wherein the svibscriber 
15 profile is an advertising preference profile for the 

subscriber, the advertising preference profile indicating the 
type of advertising of interest to the subscriber. 
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